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(57) Abstract 

A ManArray processor pipeline design addresses 
an indirect VLIW memory (206) access problem with- 
out increasing branch latency by providing a dynami- 
cally reconfigurable instruction pipeline for SIWs (241, 
243, .... 249) requiring a VLIW to be fetched. By in- 
troducing an additional cycle in the pipeline only when 
a VLIW fetch is required, the present invention solves 
the VLIW memory (206) access problem. The pipeline 
stays in an expanded state, in general, until a branch 
type or load VLIW memory (206) type operation is de- 
tected returning the pipeline to a compressed pipeline 
operation. By compressing the pipeline when a branch 
type operation is detected, the need for an additional 
cycle for the branch operation is avoided. Conse- 
quently, the shorter compressed pipeline provides more 
efficient performance for branch intensive control code 
as compared to a fixed pipeline with an expanded num- 
ber of pipeline stages. In addition, the dynamic recon- 
figurable pipeline is scalable allowing each processing 
element (PE) in an array of PEs to expand and com- 
press the pipeline in synchronism allowing the iVLIW 
operations to execute indej>endently in each PE. This 
is accomplished by having distributed pipelines in op- 
eration in parallel, one in each PE and in the controller 
sequence processor (SP). 
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METHODS AND APPARATUS TO DYNAMICALLY RECONFIGURE THE INSTRUCTION PIPELINE OF INDIRECT 
VERY LONG INSTRUCTION WORD SCALABLE PROCESSOR 

5. ' , . 

Cross-Reference to Related Applications 

The present application claims the benefit of U.S. Provisional Application Serial No. 

60/071,248 entitled "Methods and Apparatus to Dynamically Expand the Instruction Pipeline 

of a Very Long Instruction Word Processor". 

10 Field of the Invention 

The present invention relates generally to improvements in array processing, and 
more particularly to methods and apparatus for dynamically expanding and compressing the 
instruction pipeline of a very long instruction word (VLIW) processor. 
Background of the Invention 

15 In an architecture, such as the manifold array (ManArray) processor architecture, very 

long instruction words (VLIWs) are created from multiple short instruction words (SIWs) and 
are stored in VLIW memory (VIM). A mechanism suitable for accessing these VLIWs, 
formed from SIWs 1-n, is depicted in Fig. lA. First, a special kind of SIW, called an 
"execute- VLIW" (XV) instruction, is fetched from the SIW memory (SIM 10) on an SIW bus 

20 23 and stored in instruction register (IRl) 12. When an XV instruction is encountered in flie 
program, the VLIW indirectly addressed by the XV instruction is fetched from VIM 14 on a 
VLIW bus 29 and stored in VLIW instruction register (VIR) 16 to be executed in place of the 
XV instruction by sending the VLIW from VIR 3 1 to the instruction decode-and-execute 
units. 

25 Although this mechanism appears simple in concept, implementing it in a pipelined 

processor with a short clock period is not a trivial matter. This is because in a pipelined 
processor an instraction execution is broken up into a sequence of cycles, also called phases 
or stages, each of which can be overlapped with the cycles of another instruction execution 
sequence in order to improve performance. For example, consider a reduced instruction set 

30 computer (RISC) type of processor that uses three basic pipeline cycles, namely, an 

instruction fetch cycle, a decode cycle, and an execute cycle which includes a write back to 
the register file. In this 3-stage pipelined processor, the execute cycle of one instruction may 
be overlapped with the decode cycle of the next instruction and the fetch cycle of the 
instruction following the instruction in decode. To maintain short cycle times, i.e. high clock 

35 rates, the logic operations done in each cycle must be minimized and any required memory 
accesses kept as short as possible. In addition, pipelined operations require the same timing 
for each cycle with the longest timing path for one of the pipeline cycles setting the cycle 
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time for the processor. The implications of the serial two memory accesses required for the 
aforementioned indirect VLIW operation in Fig. 1 A is that for a single cycle operation to 
include both memoiy accesses would require a lengthy cycle time not conducive for a high 
clock rate machine. As suggested by analysis of Fig. 1 A wherein the VIM address Ofifset 25 
5 is contained within the XV instruction, the VIM access cannot begin until the SIM access has 
been completed. At which point, the VIM address generation unit 1 8 can create the VIM 
address 27 to select the desired VLIW from VIM 14, by adding a stored base address with the 
XV VIM OfifSet value. This constraint means that if the number of stages in a typical three- 
stage (fetch, decode, execute) instruction pipeline is to be maintained, both accesses would be 

10 required to be completed within a single clock cycle (i.e. the fetch cycle). However, due to 
the inherent delay associated with random memory accesses, even if the fastest 
semiconductor technologies available today are used, carrying this requirement to the actual 
implementation would restrict the maximum speed, and hence, the maximum performance, 
that could be attained by the architecture. 

15 On the other hand, if an additional pipeline stage were to be permanently added such 

that the memory accesses are divided across two pipeline fetch stages (Fl and F2), an even 
more undesirable effect of increasing the number of cycles it takes to execute a branch would 
result. 

Summary of the Invention 

20 The present invention addresses a dynamic reconfigurable pipeline and methods of its 

use which avoids both of the above described types of "delayed" and multi-cycle branch 
problems. Thus, this dynamic reconfigurable pipeline as discussed further below is highly 
advantageous. 

A unique ManArray processor pipeline design in accordance with the present 
25 invention advantageously solves the indirect VLIW memory access problem without 

increasing branch latency by providing a dynamically reconfigurable instruction pipeline for 
SIWs requiring a VLIW to be fetched. By introducing an additional cycle in the pipeline 
only when a VLIW fetch is required, the present invention solves the VLIW memory access 
problem. The pipeline stays in an expanded state, in general, until a branch type or non-XV- 
30 VLIW type operation is detected returning the pipe to a compressed pipeline operatioil. By 
compressing the pipeline when a branch type operation is detected, the need for an additional 
cycle for the branch operation is avoided by the present invention. Consequently, the shorter 
compressed pipeline provides more efficient performance for branch intensive control code 
as compared to a fixed pipeline with an expanded number of stages. 
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In addition, the dynamic reconfigurable pipeline is scalable allowing each processing 
element (PE) in an airay of PEs to expand and compress the pipeline in synchronism 
allowing independent iVLIW operations in each PE. This is accomplished by having 
distributed pipelines in operation in parallel, one in each PE and in the controller Sequence 
5 Processor (SP). 

The present invention also allows the SIW memory and VLIW memory to have a full 
cycle for memory access time. This approach enables an indirect VLIW processor to achieve 
a higher frequency of operation because it minimizes the logic operations and number of 
memory access required per cycle. By using this approach, a more balanced pipeline design 
10 is obtained, resulting in a micro-architecture that is more suitable for manufacturing across a 
wide-range of process technologies. 

These and other advantages of the present invention will be apparent from the 
drawings and Detailed Description which follow. 
Brief Description of the Drawings 
15 Fig. 1 A shows a VLIW instruction fetch mechanism which illustrates potential 

processing delays or bottlenecks in the absence of the present invention; 

Fig. IB illustrates a ManArray 2x2 iVLIW processor which can suitably be employed 
with this invention; 

Fig. 2 illustrates a reconfigurable instruction sequencer in accordance with the present 
20 invention; 

Fig. 3 illustrates a pipeline control state machine suitable for use in conjunction with 
the present invention; 

Fig. 3 A illustrates aspects of sequential execution order for a VLIW based compact 
instruction format suitable for use in conjunction with the present invention; 
25 Fig. 3B illustrates exemplary instruction groupings for the compact instruction format 

of Fig. 3 A; 

Fig. 4 illustrates the execution of instructions in a 4-stage instruction pipeline with 
delayed branches; 

Fig. 5 illustrates an exemplary execution of instructions in a dynamically 
30 reconfigurable instruction pipeline with delayed branches in accordance with the present 
invention; 

Fig. 6 illustrates the execution of instructions in a 4-stage pipeline with multi-cycle 
branches; 
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Fig. 7 illustrates an exemplary execution of instructions in a dynamically 
reconfigurable instruction pipeline with multi-cycle branches m accordance with the present 
invention; 

Fig. 8A illustrates operation of a reconfigurable pipeline with no compression after an 
5 SV operation; 

Fig. 8B illustrates operation of a reconfigurable pipeline with compression after an 
S V operation in accordance with the present invention; and 

Fig. 9 illustrates PE instruction pipeline control for a distributed pipeline SIMD array 
in accordance with the present invention. 
10 Detailed Description 

Further details of a presently preferred ManArray architecture for use in conjunction 
with the present invention are found in U.S. Patent Application Serial No. 08/885,310 filed 
June 30, 1997, U.S. Patent Application Serial No. 08/949,122 filed October 10, 1997, U.S. 
Patent Application Serial No. 09/169,255 filed October 9, 1998, U.S. Patent Application 
15 Serial No. 09/1 69,256 filed October 9, 1998, U.S. Patent Application Serial No. 09/169,072 
filed October 9, 1998, U.S. Patent Application Serial No. 09/187,539 filed November 6, 
1998, U.S. Patent Application Serial No. 09/205,558 filed December 4, 1998 and entitled 
"Methods and Apparatus for Dynamic Very Long Instruction Word Sub-Instruction Selection 
for Execution Time Parallelism in an Indirect Very Long Instruction Word Processor", and 
20 U.S. Patent Application Serial No. 09/215,081 filed December 18, 1998 and entitled 

"Methods and Apparatus for Scalable Instruction Set Architecture with Dynamic Compact 
Instructions", Provisional Application Serial No. 60/068,021 entitled "Methods and 
Apparatus for Scalable Instruction Set Architecture" filed December 1 8, 1 997, Provisional 
Application Serial No. 60/071,248 entitled "Methods and Apparatus to Dynamically Expand 
25 the Instruction Pipeline of a Very Long Instruction Word Processor" filed January 12, 1 998, 
Provisional Application Serial No. 60/072,915 entitled "Methods and Apparatus to Support 
Conditional Execution in a VLIW-Based Array Processor with Subword Execution" filed 
January 28, 1988, Provisional Application Serial No. 60/077,766 entitled "Register File 
Indexing Methods and Apparatus for Providing Indirect Control of Register in a VLIW 
30 Processor" filed March 12, 1998, Provisional Application Serial No. 60/092,130 entitled 

"Metfiods and Apparatus for Instruction Addressing in Indirect VLIW Processors" filed July 
9, 1998, Provisional Application Serial No. 60/103,712 entitled "Efficient Complex 
Multiplication and Fast Fourier Transform (FFT) Implementation on the ManArray" filed 
October 9, 1998, Provisional Application Serial No. 60/106,867 entitled "Methods and 
35 Apparatus for Improved Motion Estimation for Video Encoding" filed November 3, 1 998, 
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Provisional Application Serial No. 60/1 13,637 entitled "Methods and Apparatus for 
Providing Direct Memory Access (DMA) Engine" filed December 23, 1998 and Provisional 
Application Serial No. 60/1 13,555 entitled "Methods and Apparatus Providing Transfer 
Control" filed December 23, 1998, respectively, and incorporated by reference herein in their 
5 entirety. 

In a presently preferred embodiment of the present invention, a ManArray 2x2 iVLIW 
Single Instruction Multiple Data stream (SIMD) processor 100 shown in Fig. lA contains a 
controller Sequence Processor (SP) combined with Processing Element-0 (PEO) SP/PEO 101, 
as described in further detail in U.S. Application Serial No. 09/169,072 entitled "Methods 

10 and Apparatus for Dynamically Merging an Array Controller with an Array Processing 
Element". Three additional PEs 151, 153, and 155 are also utilized to demonstrate the 
dynamic reconfigurable pipeline methods and apparatus of the present invention. It is noted 
that the PEs can be also labeled with their matrix positions as shown in parentheses for PEO 
(PEOO) 101, PEl (PE01)151, PE2 (PEIO) 153, and PE3 (PEll) 155. The SP/PEO 101 

15 contains a fetch controller 1 03 to allow the fetching of SIWs from a 32-bit instruction 
memory 105. The fetch controller 103 provides the typical functions needed in a 
programmable processor such as a program counter (PC), branch capability, digital signal 
processing loop operations, support for interrupts, and provides the instruction memory 
management control which could include an instmction cache if needed by an application. In 

26 addition, the SIW I-Fetch controller 103 dispatches 32-bit SIWs to the other PEs in the 
system by means of a 32-bit instruction bus 102. 

In this exemplary system, common elements are used throughout to simplify the 
explanation, though actual implementations are not so limited. For example, the execution 
units 13 1 in the combined SP/PEO 101 can be separated into a set of execution units 

25 optimized for the control function, e.g. fixed point execution units, and the PEO as well as the 
other PEs can be optimized for a floating point application. For thje purposes of this 
description, it is assumed that the execution units 131 are of the same type in the SP/PEO and 
the other PEs. In a shnilar maimer SP/PEO and the other PEs use a five instruction slot 
iVLIW architecture which contains a VIM memory 109 and an instruction decode and VIM 

30 controller function unit 107 which receives instructions as dispatched from the SP/PEO's I- 
Fetch unit 103 and generates the VIM addresses-and-control signals 108 required to access 
the iVLIWs, identified by fte letters SLAMD in 109, stored in the VIM. The loading of the 
iVLIWs is described in further detail in U.S. Patent Application Serial No. 09/187,539 
entitled "Methods and Apparatus for Efficient Synchronous MIMD Operations with i VLIW 

35 PE-to-PE Communication". Also contained in the SP/PEO and the other PEs is a common PE 
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configurable register file 127 which is described in further detail in U.S. Patent Application 
Serial No. 09/169, 255 entitled "Methods and Apparatus for Dynamic Instruction Controlled 
Reconfiguration Register File with Extended Precision". 

Due to the combined nature of the SP/PEO, the data memory interface controller 125 
5 must handle the data processing needs of both the SP controller, with SP data in memory 121, 
and PEO, with PEO data in memory 123. The SP/PEO controller 125 also is the source of the 
data tiiat is sent over the 32-bit broadcast data bus 126. The other PEs, 1 5 1 , 153, and 155 
contain common physical data memory units 123% 123", and 123'" tiiough the data stored in 
them is generally different as required by the local processing done on each PE. The 
10 interface to these PE data memories is also a common design in PEs 1 , 2, and 3 and indicated 
by PE local memory and data bus interface logic 157, 157' and 157". Interconnecting the 
PEs for data transfer communications is cluster switch 171 further described in U.S. 
Application Serial No. 08/885,310 "Manifold Array Processor", U.S. Application Serial No. 
09/949,122 entitled "Methods and Apparatus for Manifold Array Processing", and U.S. 
1 5 Application Serial No. 09/1 69,256 entitled "Methods and Apparatus for ManAiray PE-to-PE 
Switch Control". The interface to a host processor, other peripheral devices, and/or extemal 
memory can be done in many ways. The primary mechanism shown for completeness is 
contained in a DMA control unit 181 that provides a scalable ManArray data bus 1 83 that 
connects to devices and interface units extemal to the ManArray core. The DMA control unit 

20 181 provides the data flow and bus arbitration mechanisms needed for these extemal devices 
to interface to the ManArray core memories via bus 185. 

All of the above noted patent applications are assigned to the assignee of the present 
invention and incorporated herein by reference in their entirety. 

Turning to details of the ManArray processor dynamic reconfigurable instruction 

25 pipeline design of the present invention, this pipeline design advantageously solves the 

indirect VLIW memory access problem without increasing branch latency. Branches, also 
known as jumps (JMP), calls and return instructions are operations which change the 
sequential flow of the program code. Briefly, in a sequence of fetched instructions, if an 
instruction is an XV instruction, a pipeline control unit expands the instruction pipeline by 

30 adding one cycle to allow the retrieval of the requested VLIW from VIM at the address 

specified indirectly by the XV instruction and a stored VIM base address value. The fetched 
VLIW is sent to the execution units to perform the required operation in the following cycle. 

If the pipeline has not been expanded and a received SIW is not an XV instruction 
then the instruction is passed directly to the decode-and-execution units to perform the 

35 required operation in the next stage. Note that because the pipeline was not expanded prior to 
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receiving the instruction, no delay is incurred in passing the instruction to the decode-and- 
execution units. 

Once a first XV instruction has been encountered and the pipeline has been 
expanded, instruction processing continues with SIW instructions being fetched from 
5 the short instruction word memory (SIM). A received SIW is decoded to determine if the 
instruction is a) not a branch or VLIW type of instruction, b) a branch type of instruction, or 
c) a VLIW-type (non-XV) instruction. 

If the instruction is not a branch or VLIW type of instruction, the instruction is passed 
to the decode-and-execution unit to perform the required operation. Note that because the 

10 pipeline was expanded prior to receiving the instruction, the instruction now follows the 
expanded pipeline operation sequence. If the instruction is a branch or a VLIW-type (non- 
XV) of instruction, the pipeline is compressed. 

In a presently preferred embodiment, a reconfigurable instruction sequencer 200 in 
accordance with the present invention, as shown in Fig. 2, comprises a program flow control 

15 unit 202, containing program counter logic (PC) 205, for reading instructions from an SIW 
memory 203 (SIM), a VLIW memory controller (VMC) 204 for reading instructions fi-om 
VLIW memory 206 (VIM), an instruction register 1 (IRl) 208, an instruction register 2 (IR2) 
210, VLIW instruction register (VIR) 212, pipeline control 220, multiplexer 222, 
multiplexers 224, 226, 228, and a first decode-and-execute unit-1 240, a second decode- 

20 and-execute unit-2 242, and an nth decode-and-execute unit-n 248. Instruction processing 
begins with the program flow control unit 202 generating an SIW memory fetch address and 
control signal or signals 23 1 to read an instruction from SIM 203. The instruction register 1 
208 receives the fetched SIW 233. The instruction in IRl is decoded by the VLIW memory 
controller 204 and if necessary a VLIW memory access is performed. If a VLIW memory 

25 fetch instmction is decoded, the VMC 204 generates the appropriate address and control 

signals 235 to fetch a VLIW, consisting of up to n SIWs 241, 243, 249, from the VIM 206 
and stores the fetched VLIW in the VLIW instruction register 212. The pipeline control 220 
also decodes the IRl to determine the pipeline's next state as discussed in conjunction with 



220. The pipeline state control 220 controls the multiplexer 222 and multiplexers 224, 226, 

228. Consequently, control signals "x" representing lines 271, 273, 279, and "y" 
representing line 287 are indicative of the pipeline state. In a simple case, the x multiplexer 
control lines 271 , 273, 279 can be applied to a single control line common to the 
35 multiplexers 224, 226, 228. It is anticipated, however, that for signal noise reduction and 



Fig. 3. 



30 



Fig. 3 illustrates a pipeline control state machine 300 found in the pipeline control 
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reduced power usage, it is also possible to individually control the VIJW multiplexers based 
upon decode information contained in the SIW instruction. For clarity and simplicity of 
discussion though, it will be assumed that the x signals are treated as a single control line that 
controls each multiplexer 224, 226, 228. The multiplexers 222, 224, 226, 228 have a 
5 . "0" and a " 1 " indication within the multiplexer. The "0, 1 " values indicate that when the 

control signal is a "0" the data path associated with the "0" in the multiplexer is enabled and 
when the control signal is a "1" the data path associated with the "1 " in the multiplexer is 
enabled. 

The pipeline control state machine 300 controls the general instmction sequencing 

10 and which instruction register (IRl 208, IR2 210, or VIR 212) contents are to be sent to the 
decode-and-execution units 261, 263...269 and 240, 242...248, respectively. The state 
machine 300 is designed to expand the pipeline to allow for the additional cycle required for 
the indirect VLIW memoiy fetches to occur. Once the pipeline is expanded it remains 
expanded until one of several instructions is decoded in which it is permissible to compress 

15 flie pipeline. Compressing the pipeline is permissible when a branch type instruction is 
detected or when a write access to the VLIW memory is required. 

The "Select SIW (IRl)" state 310 is the nornial operating state the processor is in 
after a reset 301 has occurred, and it indicates that the pipeline is in a compressed state. In 
the compressed state, the instruction decode is using the register output (IRl) of the SIW 

20 memory. This means that in Fig. 2 {x=0,y=0} which enables the IRl data path 281 to pass 
data through multiplexer 222 to output 285 and which is enabled to pass through multiplexers 
224, 226, 228 to the decode-and-execution units 240, 242, 248. The decode portions 
261, 263. ..269 of the decode-and-execution units determine if the instruction is to be 
executed in their respective unit or not If the instruction is not to be executed, then a no 

25 operation (NOP) proceeds through the execution unit. If it is to be executed, then the normal 
instruction decoding and execution operation occurs as specified by the received instruction. 
With appropriate decoding and control logic, only the multiplexer associated with the desired 
decode-and-execute unit can be enabled for noise and power reduction purposes. With 
appropriate decoding and control logic and with time available in the processor cycle the 

30 multiplexers 224, 226, 228 can be placed prior to the VLIW instmction register. 
Variations are possible depending upon requirements for the processor. 

The Fig. 3 select staged SIW (IR2) state 314, corresponding to Fig. 2 {x=0,y=l }, and 
select VLIW (VIR) state 312, corresponding to Fig. 2 {x=l,y=l }, indicate that the pipeline is 
in a expanded state. The select staged SIW (IR2) state is used to keep the pipeline expanded 
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while executing non-VLIW and non-branch SIW instructions that follow the execution of 
instructions from the VLIW memory. 

A transition from one state to the next is determined by decoding the IRl and IR2 
registers. The Fig. 3 components of the condition arcs "LV in SIW IRV\ "SV in SIW IRl" 

5 305 and "XV in SIW IRl" 303 and their logical NOT versions components of arcs 306, 307 
and 302 are respectively decoded from the IRl instruction register. The LV, SV, and XV 
instructions are SIW instructions that have an affect on the type of access made to the VLIW 
memory. An LV instruction loads the VLIW memory with instructions. An SV instruction, 
also known as SETV, is used to enable/disable slots of the VLIW by setting or clearing 

1 0 particular bits in the VLIW associated with each slot. An XV instruction fetches a VLIW 
from the VLIW memory to be decoded in the next cycle. 

In Fig. 3, the condition: (XV in SIW IRl) 303 represents the hardware decoding of 
the instmction in IRl to be an XV instruction. This XV in SIW IRl condition then causes tiie 
pipeline to be expanded and the VLIW to be fetched from VIM. It is noted that the LV, S V, 

15 and XV instructions are qualified by a parameter to the VMC indicating whether this is an SP 
or PE instruction by decoding the SP/PE bit of IRl . This is desirable for scalability reasons 
to be discussed later. 

If the pipeline control is in state 314 and an XV is received in IRl and there is no 
branch in IR2, then condition 308 would be met and the pipeline transitions to state 3 12 

20 where the VLIW for the XV is fetched. It is noted that the pipeline stays in state 312 with the 
repeated receiving of XVs in IRl as indicated by transition arc 304. It is also noted that the 
pipeline stays in state 3 14 as long as there is not a branch in IR2, not an LV in IRl , not an SV 
in IRl and not an XV in IRl , i.e., condition 307 is met. 

It is noted in Fig. 3 that the expanded pipeline is compressed when branch type 

25 instructions and specific Load VLIW or Set VLIW instructions are detected. Reconfiguring 
the pipeline on these conditions reduces the latency overhead as compared to changing the 
pipeline between XV and non-XV instructions. In particular, the "Branch in SIW IR2" 
component of the condition for arc 309 of Fig. 3 is decoded by looking at bits in the IR2 
instruction register. The branch condition can also be affected by the state of other system 

30 components. For example, in a ManArray indirect VLIW processor, interrupts force a branch 
to the interrupt vector table stored in the SIW memoiy. This type of branch operation can 
also cause the pipeline to compress so that there is less latency in executing the interrupt 
service routine. Whether interrupts cause the pipeline to compress may depend upon many 
factors, such as array size and application requirements. Another situation which can affect 

35 the pipelme is if the PFCU needs to arbitrate for access to the SIW memory. If the arbiter 
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does not give immediate access to read the SIW memory, the pipe can also be compressed 
from an expanded pipe. 

It is anticipated that with use of the ManArray dynamic compact instructions, further 
described in U.S. Patent Application Serial No. 09/215,081 "Methods and Apparatus for 
5 Scalable Instruction Set Architecture with Dynamic Compact Instructions", the pipeline 
would enter the expanded state whenever a dynamic pluggable iVLIW-based compact 
instruction was received, except for some of the control-type compacted instructions. It is 
noted that iVLIW-based compact instructions are those that cause an indirect access of the 
VLIW memory as part of the compact-to^32bit SIW translation process. An example of a 

10 VLIW-based compact instmction format and execute sequence order is shown in Fig. 3 A. In 
Fig. SB, the Store, Load, ALU, MAU, DSU-1, and DSU-2 instructions cause a VLIW 
memory read access as part of the translation from compact format to 32-bit format, as 
described in detail in the above patent application. The specific control type compacted 
instructions that would not cause a transition to an expanded state include, but are not limited 

15 to, branch and no-operation, NOP, type compacted instructions. These control types do not 
cause an access to the iVLIW memory and are contained in the Control- 1 and 2 instruction 
types. It is noted that a compact XV instruction can be included in, for example Control-2 
type instructions, in which case the compact XV instruction would expand the pipeline as 
previously described. To enter the expanded pipeline state, the pipeline state transition 

20 condition 303 in Fig. 3 would be modified with an OR of the detected compacted instruction 
condition. The transition condition 303 of Fig. 3 would then be of the form: Condition: (XV 
in SIW IR1)|( (i VLIW-based Compacted Instruction in IRl). In general, any instruction that 
requires a read access to the VLIW memory would cause the pipeline to enter the expanded 
state. The exit from the expanded pipeline state would occur on the reception of any branch 

25 type operation that changes the sequential flow of the program code, including compact 
branch instructions. 

While allowing the pipeline to be dynamically reconfigurable provides distinct 
advantages, there may be applications where it may be advantageous for a programmer to 
determine whether a fixed pipeline or a dynamic pipeline would be better suited to an 

30 application task. For example, having the ability to lock the pipeline provides easy 

determinism of instruction execution, when instruction and data memories have fixed access 
times. Also, in a multiple SP system, it may be of benefit to have a fixed pipeline mode of 
operation for easy synchronized communications between SPs. In addition, in support of 
future architecture developments and/or enhancements, being able to control the pipeline 
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operational characteristics provides a mechanism to determine the performance difference 
between a fixed pipeline and a dynamic pipeline based upon types of applications. 

To provide a programmer controlled locking mode, two new instructions and one status 
bit in the status control register (SCR) are provided to support locking and unlocking • 
expanded pipeline (EP) mode. The compressed pipeline mode is also referenced as the 
normal pipeline (NP) mode. The two presently preferred instructions are: 



Instruction 


Description 


JMPLK <pc-rel address> 


If executed when the pipeline is in EP mode, this 
instruction causes the pipeline to be held in EP mode 
until a JMPULK instruction is executed, at which point 
the pipeline is unlocked and reverts to NP operation. 


JMPULK <pc-rel address> 


If pipeline is in EP-locked state, then executing this 
instruction causes pipeline to revert to unlocked-NP 
state. If pipeline is not in EP-locked state, this 
instruction behaves the same way as any other PC- 
relative, unconditional JMP instruction. Executing this 
instruction guarantees that the pipeline is placed into the 
NP state. 



This approach allows the programmer to guarantee the state of the pipeline using one 
10 instruction, either JMPLK to force the pipeline to EP mode, or JMPULK to force the pipeline 
to NP mode. 

A status bit (EPLK) in the SCR indicates the locked/unlocked state of the pipeline. If 
this bit is * r, tiien the pipe is in EP-locked state, otherwise it is in unlocked state (either NP 
orEP). The use ofinstructions to lock or unlock the pipeline eliminates mode bits. The 

15 status bit is made available for software progranmiing to determine the state of the pipe. 

The state transition table below describes how the state of the pipeline changes when 
different types of instmctions are decoded. Initially, the pipeline is in NP mode. Any 
instruction which is not XV or JMPLK executes using 3 stages (not counting multiple 
execute stages for certain types of instructions). If an XV is encountered, the pipeline state is 

20 changed to EP state for the XV and subsequent instructions. If a JMPLK instruction is 

encountered, the pipeline enters EP-locked state. Subsequent instructions always follow the 
EP path. The following table shows state transitions for the pipeline for different instruction 
types. 
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Pipe State 


Instruction Inputs and Next State 


Not(XV, JMPLK) 


XV 


JMPLK 


JMPULK 


Branch 


NP 


NP 


EP 


EP-L 


NP 


NP 


EP 


EP 


EP 


EP-L 


NP 


NP 


EP-L 


EP-L 


EP-L 


EP-L 


NP 


EP-L 



The following examples are presented to demonstrate that by reconfiguring the 
pipeline the expanded pipeline does not incur any cycle time penalty as compared to a fixed 
5 pipeline of expanded length with no reconfiguration. In the examples illustrated in Figs. 4-8, 
Fl is a first fetch cycle, F2 is a second fetch cycle, D is the decode cycle, and an E is the 
execute cycle. Time in cycles proceeds fi"om left to right as indicated by the row labeled | 
Cycle 1 I 2 I ... I 10 I 410, 510, 610, 710, 810 and 820, respectively. 
Example 1 

10 A "delayed" branch instruction sequence which allows instructions to execute in the 

shadow of the branch is discussed first In this example, it is assumed the branch is taken. 
First, a 4-stage pipeline of fixed length is examined followed by a reconfigurable pipeline 
which expands to 4-stages and compresses to 3-stages as taught by this invention. With a 4- 
stage fixed pipeline, the additional pipeline stage results in the introduction of an additional 
15 "delay-slot" associated with the "delayed" branch. In the 4-stage instruction pipeline 

example of Fig. 4, a VLIW, an SIW, and a "delayed" branch are executed back-to-back as 
shown in the following pseudo-code example. 

Pseudo-Code for Fig. 4 
XV 1 ; execute VLIW 

20 sub r5, rlO, rl 1 ; execute SIW subtract 

bz next ; branch to "next" if zero detected 

Idi r2, p7+ ; execute load (1^^ delay slot instruction) 

add r4, rl, r2 ; execute add (2""^ delay slot instruction) 

Idi r3, p7+ ; execute load (S""^ delay slot instruction) 

25 ldir4, p7+ ; not executed 



next: sti r4, p8+ 



; branch target. 



It is noted that in Fig. 4 three delay slot instructions are executed seemingly to take 
30 advantage of the additional cycle of latency the "delayed" branch incurs in a fixed 4-stage 
pipeline, but in practice it is not always possible to make use of the additional delay slots. 
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Consequently, as compared to a 3-stage pipeline the 4-stage delayed branches will be less 
efficient to use. 

With the dynamic reconfigurable pipeline in expanded state, the pipeline control unit 
220 of Fig. 2 compresses the pipeline by removing the previously added stage (or cycle) as 
soon as the outcome of the branch is determined (i.e. whether the branch is taken or not). 
This mechanism is illustrated in the example shown in Fig. 5. 

In the pseudo-code example for Fig. 5, a VLIW, an SIW, and a delayed branch are 
executed back-to-back. 



Referring to Fig. 5 for operation sequence and Fig. 2 for hardware operation, the 
reconfigurable pipeline is discussed in operation for the above pseudo-code sequence. First, 
the XV is fetched Fl from SIM 203 in Cycle- 1 and is received in instruction register IRl 208 
by the end of Cycle- 1 . 

During Cycle-2, the SUB instruction is fetched, Fl cycle, firom SIM 203 and is 
received in IRl 208 by the end of Cycle-2. In the beginning of Cycle-2, the IRl instruction is 
decoded as an XV instruction. In response, the VLIW memory control 204 retrieves the 
requested VLIW from VIM 206, F2 cycle, and loads it into the VIR 212 by the end of Cycle- 
2, and the pipeline-control 220 extends the pipeline by inserting a new cycle (stage) to allow 
the VIM access. 

During Cycle-3 the BZ instruction is fetched, Fl cycle, from SIM 203 and is received 
in IRl 208 by the end of Cycle-3. At the beginning of Cycle-3, the instmction in IRl 208, 
the subtract instruction, since the pipeline has been expanded, is passed to IR2 210 by the end 
of Cycle-3. For other reasons that affect the program operation, the instruction in IRl is 
determined to not be a branch instruction. In Cycle-3, the fetched VLIW is in the decode D 
cycle in the decode-and-execution units. 



Pseudo-Code for Fig.5 
XV 1 ; execute VLIW 

sub r5, rl 0, rl 1 ; execute SIW subtract 

bz next ; branch to "next" if zero detected 

Idi r2, p7+ ; execute load (1** delay slot instruction) 

add r4, rl , r2 ; execute add (2"^ delay slot instruction) 

Idi r3, p7+ ; not executed 



next: sti r4, p8+ 



; branch target. 
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During Cycle-4, the load Idi instruction is fetched, Fl cycle, from SIM 203 and is 
received in IRl 208 by the end of Cycle-4. At the beginning of Cycle-4, the instruction in 
IRl 208, the branch (bz) instruction, since the pipeline has been expanded, is passed to IR2 
210 by the end of Cycle-4. For other reasons that affect flie program operation, the 

5 instruction in IRl is determined to be a branch instruction which is used by the program flow 
control unit 202. In Cycle-4, the subtract (sub) instruction is in the decode D cycle in the 
decode-and execution unit and the VLIW is in the execute E cycle. 

During Cycle-5, the add instruction is fetched, Fl cycle, from SIM 203 and is 
received in IRl 208 by the end of Cycle-5. At the begiiming of Cycle-5, the instruction in 

10 IRl 208, the load Idi instruction, since the pipeline has been expanded, is passed to IR2 210 
by the end of Cycle-5. For other reasons that affect the program operation the instruction in 
IRl is determined to not be a branch instruction. At the beginning of Cycle-5, the branch 
instruction in IR2 210 is determined to be a delayed branch instruction and a Branch_op 
signal 289 is sent to the pipeline control unit. In response to the control signal, the pipeline 

15 control unit 220 compresses the pipeline by removing the expanded cycle (stage) at the 

beginning of Cycle 7 after the outcome of the branch has been determined in Cycle 6. The 
other instructions follow a similar sequence of events for the remaining cycles shown in Fig. 
5. In Cycle 7, the pipeline is restored to its normal compressed state, after which the F2 stage 
is no longer used. 

20 Because the pipeline is restored to its compressed state in the presence of a delayed 

branch with the present invention, the number of delay slots following the delayed branch 
instruction is kept at two. This compares favorably with the three delayed slots required with 
the fixed 4-stage pipeline of Fig. 4. 
Example 2 

25 A multi-cycle branch instruction does not allow any instructions to execute in the 

"shadow" of the branch. It is assumed the branch is taken in the example. A 4-stage pipeline 
of fixed length is first examined, followed by a reconfigurable pipeline which expands to 4- 
stages and compresses to 3-stages as outlined by this invention. With a 4-stage fixed pipeline 
and a branch of the multi-cycle type, the addition of a pipeline cycle (stage) results in an 

30 increase in the number of cycles it takes to resume instruction execution after the branch has 
been resolved. This is illustrated in the example of Fig. 6. In Fig. 6, "nop" is used to indicate 
that no operation is being performed. 

In the 4-stage instruction pipeline pseudo-code example for Fig. 6, a VLIW, an SIW, 
and a "multi-cycle" branch are executed back-to-back. 

35 



:WO _0042499A1 l_> 




wo 00/42499 -,5 PCTAJSOO/00569 

Pseudo-Code for Fig. 6 
XV 1 ; execute VLIW 

sub r5, rlO, rl 1 ; execute SIW subtract 

bz next ; branch to "next" if zero detected 

5 Idi r2, p7+ ; not executed 

add r4, rl , r2 ; not executed 

ldir3,p7H- ; not executed 

Idi r4, p7-f ; not executed 

10 next: sti r4, p8+ ; branch target. 

The main distinction between the multi-cycle branch operation and the "delayed" 
branch operation is that when a multi-cycle branch is detected in IRl, the program flow 
control unit 202 prevents further sequential addressing of the SIM. The last fetched 
instruction, in this case the load Idi instruction, is not allowed to progress through the 
1 5 pipeline. It is noted tiiat 3-nop cycles, cycles 7, 8, and 9, are experienced, delaying the start 
of the code sequence at the branch target. 

With the djmamic reconfigurable pipeline in expanded state, the pipeline control unit 
220 compresses the pipeline by removing the previously added stage (or cycle) as soon as the 
outcome of the branch is determined (i.e. whether the branch is taken or not). This 
20 mechanism is illustrated in the example shown in Fig. 7. In the pseudo-code example below, 
a VLIW, an SIW, and a multi-cycle branch are executed back-to-back. 
Pseudo-Code for Fig. 7 
XV 1 . ; execute VLIW 

sub r5, rl 0, rl 1 ; execute SIW subtract 

25 bz next ; branch to "next" if zero detected 

Idi r2, p7-H ; not executed 

add r4, rl , r2 ; not executed 

Idi r3, p7+ ; not executed 

30 next: sti r4, p8-f ; branch target. 

The following discussion addresses several important aspects illustrated in Fig. 7. At 
the begirming of Cycle-5, the branch instruction in IR2 210 is determined to be a multi-cycle 
branch instruction and a Branch_op signal 289 is sent to the pipeUne control unit. In 
35 response to the control signal, the pipeline control unit 220 compresses the pipeline by 
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removing the expanded cycle (stage) at the beginning of Cycle 7 after the outcome of the 
branch has been determined in Cycle 6, The other instructions follow a similar sequence of 
events for the remaining cycles shown in Fig. 7. In Cycle 7, the pipeline is restored to its 
normal compressed state, after which the F2 stage is no longer used. 



cycle branch with the present invention, the number of cycles it takes for instruction 
execution to resume after the multi-cycle branch instruction is kept at two, Fig. 7 cycles 7 and 
8. This operation compares favorably with the three nop slots required with the fixed 4-stage 
pipeline of Fig. 6. 
10 Example 3 

Figs. 8A and SB illustrate why it is advantageous to compress the pipeline for an SV 
or LV instruction. By compressing during a SV instruction the number of cycles it takes to 
fetch the branch target (B-trg) is reduced by one. This is seen by comparing cycles 4, 5, and 
6 of Fig. 8A with those for Fig. 8B. Figs. 8A and 8B depict XV, SV, BZ and branch target 

1 5 (B-trg) instruction pipeline sequences to highlight the differences between the two. In Fig. 
8 A with no compression after an SV, a nop cycle, cycle-5, is required between the execution 
of the VLIW and the bz instruction. In Fig. 8B, with compression after an SV, no nop cycle 
is needed and the bz instruction is executed directly after the VLIW. It is noted that no cycles 
are lost if the branch (bz) had been an XV instruction. In Figs. 8A and 8B, EP stands for 

20 expanded pipeline and NP for normal (compressed) pipeline. A transition from EP to NP 
indicates that the pipeline has been compressed. The dashes represent instructions not 
pertinent to this disclosure. 
Scalable Reconfigurable Pipeline 



25 instruction-multiple-data (SIMD) processor comprising at least one processing element (PE), 
each having its own VIM, and a controller sequence processor (SP), where the PEs are 
configured to operate as a scalable array of processors controlled by the SP, for example the 
ManArray processor 100 of Fig. IB. In such a processor, the SIWs are fetched and 
distributed to the PEs by the controller SP, and are decoded and executed by both. The 

30 dynamic reconfigurable instruction pipeline is extendible for parallel array processing by 

providing distributed pipelines where each PE contains its own pipeline control and a subset 
of the program flow control unit. Such a PE pipeline is depicted in Fig. 9 which operates in 
the same manner as the pipeline of Fig. 2 except that there is no SIW fetching controls since 
no SIM memory exists in the PEs. The PE instruction flow control unit 902 provides similar 

35 functions to the program flow control unit (PFCU) 202 in Fig. 2 with the removal of the 



5 



Because the pipeline is restored to its compressed state in the presence of a multi- 



As address above, the present invention is advantageously applicable to a single- 
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program counter PC, SIW memory fetch control function, and other SP-only controller 
functions such as support for interrupts. The state machine 300 of Fig. 3 applies equally well 
for the PE pipeline control and retains the same functions in the PEs of this latter 
embodiment. All conditions associated with the transition arcs between states in Fig. -3 are 
5 determined locally in each PE, though the SP may forward specific information necessary to 
accomplish this end. For example, compressing the pipeline after interrupts, if necessary, 
would require a signal from the SP, dispatched to all PEs, to cause the pipelines to compress. 
It is possible to reconfigure the pipeline in an array processor since all instructions fetched by 
the SP instruction sequencer are dispatched to all PEs in the array in sjoichronous fashion. 
10 This is shown in Fig. IB with instraction bus 1 02 going to each PE in the exemplary 2x2 
system shown. 



PE instructions. It is noted that decoding of special opcodes to determine the SP/PE 
15 distinction is not precluded. The pipeline is distributed, wifli pipeline control local in each 
PE, in order to minimize the timing paths dependent upon pipeline state machine controls, 
such as the {x,y} signals discussed in Fig. 2. It is anticipated that other mechanisms can be 
made available to control the pipelines in each PE. For example, for low power and lower 
processor clock rates or with small array configurations, the pipeline control can be 
20 centralized rather than distributed. 

While the present invention has been described in a variety of presently preferred 
embodiments, it will be recognized that ja number of variations will be readily apparent and 
that the present teachings may be widely applied. 



In Fig. 9, the instruction bus 905 is received into each PE's IRl 908. In the ManArray 
architecture, a specific bit in the instruction format, is used to differentiate between SP and 



XIID: <WO 0O42499A1_L> 



wo 00/42499 18 I^CTAJSOp/00569 

We claim: 

1 . An apparatus for dynamically expanding an instruction pipeline with a second 
fetch cycle for a VLIW memory access when required for indirect accessing of a very long 
word instruction words (VLIWs) in a VLIW processor comprising: 

5 a plurality of instruction decode and execute units; 

an instruction sequencer including: 
a program flow control unit; 

a first random access memory for storing short instruction words (SIWs) used 
in a serial operations in a single decode and execute unit; 
10 an instruction register one for storing SIWs fetched from the first random 

access memory; 

a second random access memory for storing VLIWs used in 
operations involving the execution of two or more execute units in parallel; 
a VLIW memory control unit; 
15 an instruction register two for storing SIWs in an expanded pipeline mode of 

operation; 

a VLIW instruction register for storing VLIWs fetched from the second 
random access memory; 

a first and second decoding circuits; and 
20 a pipeline control function that controls the data flow paths to the decode and 

execute units for the purposes of reconfiguring the pipeline in an expanded or a 
compressed mode of operation. 

2. The apparatus of claim 1 wherein the program flow control unit comprises a 
program counter and a SIW memory fetch mechanism which are operable to begin 

25 instruction processing by fetching SIWs from the first random access memory. 

3. The apparatus of claim 2 where in the first instruction decoding circuit 
receives the fetched SIW and produces a control signal indicating if a fetch from the second 
random access memory is required. 

4. The apparatus of claim 1 wherein the VLIW memory control unit comprises a 
30 VLIW memory fetch mechanism which is operable to fetch VLIWs from the second random 

access memory. 

5. The apparatus of claim 3 wherein the pipeline control unit is operable to 
expand the pipeline to allow sufficient time for a second memory fetch based upon said 
control signal. 
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6. The apparatus of claim 5 wherein the pipeline in an expanded state further 
involves a second decoding circuit to produce the control signals necessary to control the data 
path to the decode and execute units for fetched SIWs. 

7. The apparatus of claim 5 wherein the pipeline in an expanded state further 

5 involves a second decoding circuit to produce the control signals necessary to control the data 
path to the decode and execute units for fetched VLIWs. 

8. The apparatus of claim 3 wherein the first instruction decoding circuit decodes 
a received SIW and produces a control signal indicating if the SIW is a branch type 
instruction. 

10 9. The apparatus of claim 3 wherein the first instruction decoding circuit decodeis 

a received SIW and produces a control signal indicating if the SIW is a LV or SV insruction. 

10. The apparatus of claim 5 wherein the pipeline in an expanded state further 
involves a second decoding circuit to produce the control signals indicating a branch is in 
instruction register two necessary to compress the pipeline to eliminate the need for an 

15 addition fetch cycle following the execution of the branch, 

11. The apparatus of claim 1 wherein the reconfigurable pipeline control can be 
locked in an expanded state or allowed to dynamically expand or compress the pipelinie by 
use of: 

a first special branch type instruction which locks the pipeline in a expanded state; 

20 and 

a second special branch type instruction which compresses the pipeline and allow 
dynamic reconfiguration to operate. 

12. The apparatus of claim 1 1 further comprising a status bit which indicates the 
locked or unlocked state of the pipeline. 

25 13. The apparatus of claim 1 wherein an indirect VLIW type of compact 

instruction causes the pipeline to enter an expanded pipeline state, 

14. The apparatus of claim 13 wherein a first instruction decoding circuit receives 

a fetched SIW containing compact instructions and produces a control signal indicating a 

fetch from the second random access memory is required. 
30 15. The apparatus of claim 14 wherein the pipeline control unit is operable to 

expand the pipeline to allow sufficient time for a special memory fetch based upon said 

control signal. 

16. The apparatus of claim 14 wherein the first instruction decoding circuit 
decodes a compact branch type instruction producing the control signals necessary to 
35 compress the pipeline. 
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17. A SIMD indirect VLIW array processor comprising a sequencer control unit 
with a reconfigurable instruction sequencer and distributed PE reconfigurable pipeline 
controllers allowing each PE to expand and compress the pipeline locally with each PE. 

18. A method for dynamically expanding an instruction pipeline with a second 
5 fetch cycle for a VLIW memory access when required for indirect accessing of a very long 

word instruction words (VLIWs) in a VLIW processor having a plurality of instruction units, 
first and second decoding circuits, and an instruction processing control unit, the method 
comprising the steps of: 

storing short instmction words (SIWs) used in serial operations with a single 
10 execution unit in a first random access memory; 

storing VLIWs used in operations involving tiie execution of two or more execution 
units in parallel in a second random access memory; 

reading SIWs from the first random access memory utilizing a first instruction fetch 
mechanism; 

15 utilizing a simple decode mechanism to determine if a VLIW access and expanded 

pipeline is required; 

expanding the pipeline; and 

reading VLIWs from the second random access memory utilizing a second instruction 
fetch mechanism. 

20 19. The method of claim 1 8 further comprising the step of: 

beginning instruction processing with the first instruction fetch mechanism reading an 
SIW from the first random access memory as controlled by the instruction processing control 
unit. 

20. The method of claim 19 further comprising the steps of: 

25 receiving a fetched SIW in the first instruction decoding circuit; and 

producing a control signal indicating if a fetch from the second random access 
memory is required. 

21 . The apparatus of claim 20 further comprising the step of: 

utilizing the instruction processing control unit and the second decoding circuit to 
30 produce the control signals necessary to control the plurality of execution units for serial 
operation. 

22. The method of claim 20 further comprising the step of: 

utilizing the instruction processing control unit to control operation of the second 
decoding circuit on a delayed basis thereby effectively expanding the pipeline to allow 
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sufficient time for a second fetch for purposes of fetching a VLIW from the second random 
access memory. 

23 . The method of claim 22 wherein subsequent to the VLIW having been 
successfully fetched, the method further comprises the step of: ^ 

5 receiving and processing the VLIW by the second decoding circuit to produce the 

control signals necessary to control the plurality of execution units for parallel operation. 

24. The method of claim 1 9 further comprising the steps of: 
receiving the fetched SIW in the first instruction decoding circuit; and 
producing a control signal indicating if a branch in the program is required. 

10 25. The method of claim 24 further comprising the step of: 

utilizing the instruction processing control unit to involve the second decoding circuit 
on a non-delayed basis thereby effectively compressing the pipeline to eliminate the need for 
an additional delay slot following the execution of the branch. 

26. The method of claim 1 8 further comprising the steps of: 

15 determining that the pipeline has not been expanded and a received SIW is not an XV 

instruction; and 

passing the received SIW directly to a decode and execution unit. 

27. The method of claim 26 further comprising the step of performing the 
operation required by the SIW in the next stage. 

20 28. The method of claim 1 8 further comprising the steps of: 

determining that a received SIW requires a read access to the VLIW memory; and 

expanding the pipeline based upon said determination. 

29. The method of claim 28 further comprising the step of: 

exiting the expanded pipeline state on receiving any branch type operation that 

25 changes sequential flow of program code. 
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